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Fig. 2 




INPUT NEW MPEG-2 FILE AND 
CREATE REDUCED-QUALITY 
MPEG FILE AS AVAILABLE 
RESOURCES PERMIT 



YES 



NO 




YES 



BROWSE THROUGH 
REDUCED-QUALITY 
MPEG FILE TO SELECT 
IN-POINTS AND 
OUT-POINTS OF CLIPS 
TO BE SPLICED 



56 



STREAM COMPRESSED 
VIDEO FROM REDUCED 
QUALITY MPEG FILE 



60 



STREAM ORIGINAL QUALITY l-FRAMES 
AND 3 FREEZE FRAMES PER l-FRAME 




STREAM ORIGINAL 
QUALITY MPEG-2 
CODED VIDEO 



SELECT 1 OR 2 FREEZE FRAMES PER 
l-FRAME FOR DESIRED SPEED-UP 



62 



STREAM REDUCED-QUALITY l-FRAMES 
AND INSERTED FREEZE FRAMES 
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( MPEG SPLICING ) 



INPUT DESIRED END FRAME OF FIRST CLIP AND 
DESIRED START FRAME OF SECOND CLIP 



121 



FIND CLOSEST I FRAME PRECEDING DESIRED START 
FRAME TO BE THE IN-POINT FOR SPLICING 



— 122 



ADJUST CONTENT OF THE FIRST CLIP NEAR THE END 
FRAME OF THE FIRST CLIP AND ADJUST CONTENT OF 
THE SECOND CLIP NEAR THE IN POINT IN ORDER TO 
REDUCE PRESENTATION DISCONTINUITY AND PREVENT 
DECODER BUFFER OVERFLOW WHEN DECODING 
THE SPLICED MPEG STREAM 



— 123 



RE-FORMATTING INCLUDING RE-STAMPING OF 
PTS, DTS AND PCR'S FOR AUDIO AND VIDEO 



( END ) 



— 124 



Fig. 3 
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( SEAMLESS VIDEO SPLICING ) 



141 



ANCHOR THE FIRST DTS OF THE SECOND CLIP 
AT ONE FRAME INTERVAL LATER THAN THE 
LAST DTS OF THE FIRST CLIP TO PREVENT 
VIDEO DECODING DISCONTINUITY 



142 



DOES 
THE PCR 
EXTRAPOLATED TO 
THE BEGINNING FRAME OF THE 
SECOND CLIP FALL JUST 
AFTER THE ENDING 
TIME OF THE FIRST 
CLIP 
? 

NO 



YES 



ADJUST THE CONTENT OF THE 
FIRST CLIP SO THAT THE PCR 
EXTRAPOLATED TO THE 
143 — | BEGINNING FRAME OF THE 
SECOND CLIP FALLS JUST 
AFTER THE ENDING TIME OF 
THE FIRST CLIP 



( END ) 



Fig. 4 
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( VIDEO SPLICING ) 



DETERMINE THE LAST DTS/PTS OF THE FIRST CLIP 

(DTSli) 



DETERMINE THE TIME OF ARRIVAL ( Te ) _ 
OF THE LAST BYTE OF THE FIRST CLIP ' 152 



ADD ONE FRAME INTERVAL TO DTSli 
TO FIND THE DESIRED FIRST DTS 
LOCATION FOR THE SECOND CLIP 
( DTS F 1 =DTS L 1 +1/FR ) 



KEEPING THE DTS-PCRe RELATION UNALTERED 
FOR THE SECOND CLIP, FIND THE TIME INSTANT 
Ts AT WHICH THE FIRST BYTE OF THE SECOND 
CLIP SHOULD ARRIVE 
(T START =DTS F 2 -PCR e2 ) 

(Ts =DTSfi -T start ) 



B 

Fig. 5 




YES 



158 



OPEN UP A CERTAIN AMOUNT OF SPACE 
IN THE FIRST CLIP TO ACHIEVE 

T S =T e + 

BIT RATE 

THE NUMBER OF BYTES TO DROP IS 

1 + (Te-Ts )(BIT RATE) 
8 

IF POSSIBLE, REMOVE NULL PACKETS TO 
DROP THE BYTES, OTHERWISE, REPLACE 
ONE OR MORE FRAMES AT THE END OF 
THE FIRST CLIP WITH CORRESPONDING 
REDUCED-QUALITY FRAMES. 



159 — 



CONCATENATE 
THE STREAMS 



160 — 



COMPUTE THE VIDEO TIME 
STAMP OFFSET Vqffset 



■{ END ) 
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Fig. 7 
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Fig. 8 
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( TRICK MODE AUDIO ALIGNMENT ) 




175 



BEGIN NEXT APU 



174 



INCREMENT 
APU POINTER 



ADVANCE APU POINTER TO THE FIRST 
APU BEGINNING IN THE DURATION OF 
THE VPU OF THE l-FRAME IN THE 
ORIGINAL MPEG-2 STREAM 
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Fig. 9 
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( TRICK MODE STREAM^) 



181 



INPUT MPEG-2 TS FROM 
WHICH A TRICK MODE 
CLIP WILL BE EXTRACTED 



182 



VIDEO ELEMENTARY STREAM 
( VES ) EXTRACTED 



184 



I FRAME EXTRACTION AND 
VALID PES FORMATION 



-■m 



AUDIO ELEMENTARY STREAM 
(AES ) EXTRACTED 



187 



SELECTION AND CONCATENATION 
OF THE APPROPRIATE AUDIO ACCESS 
UNITS (FROM THE ORIGINAL ASSET) 
BASED ON THE STRUCTURE OF THE 
VES IN THE TRICK MODE CLIP AND 
VALID PES ENCAPSULATION AROUND 
THESE AUDIO ACCESS UNITS 



185 





SNR SCALING OF THE 
l-FRAMES-ONLY PES 




186-^ , 





FREEZE P FRAME INSERTION 
AND VALID PES FORMATION 



188 



TS STREAM GENERATION BY 
MULTIPLEXING THE ABOVE 
VIDEO PES INTO A SYSTEM 
INFO (SI) AND AUDIO PES 
CARRYING TS SKELETON 



( END ) 

Fig. 10 
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■222 



221 



REMOVE DCT COEFFICIENTS 
FOR SPATIAL FREQUENCIES 
IN EXCESS OF THE NYQUIST 
FREQUENCY FOR THE 
DOWNSAMPLED VIDEO 



NO 



YES 





■225 



RETAIN UP TO A CERTAIN NUMBER OF 
LOWEST-ORDER AC DCT COEFFICIENTS 
FOR EACH BLOCK AND REMOVE ANY 
ADDITIONAL AC DCT COEFFICIENTS 
FOR EACH BLOCK 



■227 



RETAIN UP TO A CERTAIN NUMBER OF 
LARGEST MAGNITUDE AC DCT 
COEFFICIENTS FOR EACH BLOCK 
AND REMOVE ANY ADDITIONAL AC 
DCT COEFFICIENTS FOR EACH BLOCK 



229 



RETAIN UP TO A CERTAIN NUMBER 
OF AC DCT COEFFICIENTS THAT 
DIFFER IN MAGNITUDE FROM UP 
TO THAT NUMBER OF LARGEST 
MAGNITUDE AC DCT COEFFICIENTS 
BY NO MORE THAN A CERTAIN LIMIT 



( RETURN ) 



Fig. 13 
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( FDSNR-LP ) 



PARSE AND COPY THE DIFFERENTIAL 
DC COEFFICIENT VLC. 



■241 



LET L=0 — 242 



■243 



PARSE THE NEXT (RUN, LEVEL) EVENT VLC. 



244 




■245 



YES 



COPY 
VLC 



246 



NO 



LET R= RUN LENGTH OF ZEROES FOR 
THE CURRENT (RUN, LEVEL) EVENT 



247 



■248 




YES 



COPY EOB 
MARKER 



251 



NO 



LET 

L=L+R+1 



NO 



250 




YES 



253 



COPY 
VLC 



COPY 
VLC 



— 252 



254 — 



COPY EOB 
MARKER 



249 — 



PARSE UNTIL THE END OF THE NEXT EOB 
MARKER IN THE INPUT BIT STREAM 



Fig. 14 
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C 



FDSNR-LM 



PARSE AND COPY THE DIFFERENTIAL 
DC COEFFICIENT VLC 



— 261 



PARSE AND DECODE ALL ( RUN, LEVEL ) 
EVENT VLC S UNTIL AND INCLUDING 
THE FIRST EOB MARKER 



— 262 



TRANSFORM THE QUANTIZATION INDICES 
TO QUANTIZED COEFFICIENT VALUES 



—263 



SORT THE COEFFICIENTS IN DESCENDING 
ORDER OF THEIR MAGNITUDES 



— 264 



KEEP THE FIRST K COEFFICIENTS OF THE 
SORTED LIST AND SET THE LAST 63-K 
COEFFICIENTS OF THE SORTED LIST TO ZERO 



— 265 



APPLY ( RUN, LEVEL ) EVENT FORMATION AND ENTROPY 
ENCODING TO THE NEW SET OF COEFFICIENTS 



COPY THE RESULTING VLC s TO THE OUTPUT 
UNTIL AND INCLUDING THE EOB MARKER 



— 267 



( return") 



Fig. 15 
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( SORT K FROM N ) 



O —281 



■282 



GET NEXT COEFFICIENT 
FROM INPUT STREAM 



283 




EOB 



YES 



284 



NO 



( RETURN ) 



287 



SORT THE 
LIST OF K 
COEFFICIENTS 
BY MAGNITUDE 




YES 



285 



PUT COEFFICIENT 
INDEX AND MAGNITUDE 
INTO SORT LIST 



i + 1 —286 



288 



COEFFICIENT 
MAGNITUDE > MAGNITUDE 
AT END OF LIST 

9 



YES 



® — ~ 


NO 


GET NEXT COEFFICIENT 
FROM INPUT STREAM 




r 



■289 




290 



■291 



REMOVE ENTRY AT THE 
END OF THE LIST 



■292 



BINARY SEARCH FOR RANK 
POSITION OF CURRENT 
COEFFICIENT 



■293 



INSERT CURRENT 
COEFFICIENT INDEX AND 
MAGNITUDE INTO THE LIST 
AT THE RANK POSITION 



Fig. 17 
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APPROXIMATE 
SORT K FROM N 



311 



CLEAR HASH TABLE 



■312 



GET NEXT 
COEFFICIENT FROM 
INPUT STREAM 



313 




EOB 



YES 



■316 



2 M -1 
K 



317 



INDEX HASH 
TABLE WITH 



318 



NO 




YES 



314 



STRIP HASH TABLE 
INDEX FROM MSB S 
OF COEFFICIENT 
MAGNITUDE 



315 



INSERT COEFFICIENT 
INDEX ON HASH 
LIST OF INDEXED 
HASH TABLE ENTRY 



NO 



■321 



GET NEXT ENTRY FROM 
HASH LIST AND PUT 
COEFFICIENT IN THE 
OUTPUT STREAM 






NO 

r 




- J-1 







— 323 



Fig. 19 
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1 



MODIFIED 
FDSNR-LM 



■331 



FIND UP TO k LARGEST MAGNITUDE NON-ZERO 
AC DCT COEFFICIENTS (i.e., THE "QUALIFYING 
COEFFICIENTS") FOR THE BLOCK 



■332 



■337 



BEGIN (RUN, LEVEL) 
CODING OF THE QUALIFYING 
COEFFICIENTS IN SCAN 
ORDER, USING THE SECOND 
CODING TABLE (TABLE 1) 



CONTINUE (RUN, LEVEL) 
CODING OF THE QUALIFYING 
COEFFICIENTS IN SCAN 
ORDER USING THE SECOND 
CODING TABLE 




336 



IF POSSIBLE, INCLUDE ANON-ZERO, 
NON-QUALIFYING AC DCT COEFFICIENT 
IN THE (RUN LEVEL) CODING TO 
ELIMINATE THE ESCAPE SEQUENCE 



■335 




Fig. 20 
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( ATTEMPT ELIMINATION OF ESCAPE SEQUENCE ) 



341 



IDENTIFY THE FIRST QUALIFYING 
COEFFICIENT AND THE SECOND 
QUALIFYING COEFFICIENT 
CAUSING THE ESCAPE SEQUENCE 



342 



LOOK FOR A NON-ZERO, 
NON-QUALIFYING AC DCT 
COEFFICIENT BETWEEN THE 
FIRST AND THE SECOND 
QUALIFYING COEFFICIENTS IN 
THE SCAN ORDER SEQUENCE 






NO S RETURN 




^ UNSUCCESSFUL 


344^ , 




(RUN, LEVEL) CODE THE NON-ZERO 


NON-QUALIFYING COEFFICIENT 


345-^ J 






YES 



■346 



(RUN, LEVEL) CODE THE SECOND 
QUALIFYING COEFFICIENT, 
USING THE NEW RUN LENGTH 



347 




YES 




NO 



SEARCH FOR 
ADDITIONAL NON-ZERO 
NON-QUALIFYING 
COEFFICIENTS THAT 
WILL ELIMINATE THE 
ESCAPE SEQUENCE 




SELECT THE 
NON-QUALIFYING 
COEFFICIENT GIVING THE 
SHORTEST OVERALL 
CODE LENGTH AND/OR 
THE LARGEST MAGNITUDE 
FOR THE BEST PSNR 



RETURN 
SUCCESSFUL 



l_ 
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9, QSF-^2 — 361 



Fig. 22 
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NO 
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YES 



384 



364 



INTRA 
VLC - FORMAT 
= O 
? 

YES 



NO 




YES 



( RETURN ) 



READ IN TABLE O 



■365 



READ IN TABLE 1 



NO 



366 



APPLY MODIFIED FDSNR-LM PROCEDURE, USING 
ADJUSTED QUANTIZER SCALE INDEX IF LESS THAN 
THE MAXIMUM POSSIBLE QUANTIZER SCALE INDEX 



367 




368 



YES 




YES 



369 




YES 



■370 



QSF- 



QSFx2 



NO 



3 




~i 



376 



ATTEMPT RE-CODING FOR LAST 
SLICE USING ADJUSTED QUANTIZER 
SCALE AND SELECT NEW CODING OR 
CODING THAT GIVES BEST RESULTS 




NO 



YES 



377 



YES 



380 




YES 



■378 



k-1 




YES 



■381 



k +1 



NO 



■382 



383 




ATTEMPT RE-CODING FOR LAST 
SLICE USING ADJUSTED k VALUE 



BACKTRACK 
OPTION 

'yes 



0 
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GOP= IBBPBBPBBP 



GOP= I 



MAIN 
FILE 



391 
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1- Play from start 1 sec 

2- Pause 

3- Fast Forward to 29 min 

Fi§* 26B 5 _ pi ay -i sec 

6- Pause 

7- Fast Reverse to 1 sec 

8- Pause 

9- Play Normal 





READ 


WRITE 


COPY OF THE ASSET 
WITH ALL THE DATA 


EMPEG2 


EMPEG2 


COPY ONLY THE 
MAIN ASSET 


RAW 


MPEG2 


ARCHIVE 


EMPEG2 


EMPEG2 


PLAY 


MPEG2 




RECORD 




MPEG2 



Fig. 27 



MpegFast 



M peg Fast Forward 



TrickFilesAccess 



MpegFastReverse 



RealTimeFastFwd 



TrickFilesGenerate 



RealTimeFastRev 



Fig. 28 
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(active pause on i-frame) 



541 



GET NEXT I FRAME IN 
STREAM FROM TIME OF 
THE PAUSE REQUEST 



542 



COMPUTE No. OF FROZEN 
FRAMES NEEDED FOR PAUSE 
GOP FROM THE I FRAME SIZE 
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CONSTRUCT A PAUSE GOP 
INCLUDING THE 1 FRAME AND 
THE FROZEN FRAMES IN THE 
PAUSE VIDEO BUFFERS 
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SEAMLESS SPLICE FROM 
NORMAL PLAY BUFFER TO 
PAUSE GOP IN THE PAUSE 
VIDEO BUFFERS 



Fig. 33 
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INSERT PADDING, NEW PTS, 
PCR, AND CONTINUITY VALUES, 
AND SELECTED AUDIO PACKETS 
INTO THE TRANSPORT STREAM 
TO AVOID AUDIO AND VIDEO 
DISCONTINUITIES WHILE 
REPEATING PLAY OF THE 
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INCLUDING THE NEW I FRAME, 
AND PUT THE NEW PAUSE 
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VIDEO BUFFERS 
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REPOPULATE NORMAL PLAY VIDEO 
BUFFER STARTING WITH NEW I FRAME 



SEAMLESS SPLICE FROM THE PAUSE GOP 
TO THE I FRAME IN THE NORMAL PLAY 
VIDEO BUFFERS. IF THE I FRAME IS AN 
OPEN GOP, EACH B FRAME IMMEDIATELY 
FOLLOWING THE I FRAME IS REPLACED 
WITH A FROZEN B OR P FRAME 
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( SLICE-BY-SLICE FIELD REPLACEMENT^ 
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PUT SELECTED 1 FRAME IN THE 
PAUSE VIDEO BUFFERS C 






ACTIVATE BACKGROUND TASK OF 
REPLACEMENT OF A FIELD IN THE 
SELECTED l-FRAME BY TRANSCODING 
ON A SLICE-BY-SLICE BASIS 
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FROM THE PAUSE VIDEO BUFFER 
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